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The  influence  of  Seniority  on 
2 

C  Experimental  Performance 


BACKGROUND 


This  report  examines  the  influence  of  seniority  on 

2 

performance  during  a  command  and  control  (C  )  effectiveness 

experiment  and  is  based  on  data  obtained  during  the  third  in  a 

2 

series  of  experiments  designed  to  examine  the  influence  of  C 
organization  on  system  performance.* 

The  experiments  are  part  of  a  larger  program,  whose 

2 

purpose  is  to  define,  measure,  and  identify  determinants  of  C 

effectiveness.  The  experimental  effort  is  jointly  sponsored  by 

the  Defense  Communications  Agency  (DCA)  and  the  U.S.  Naval 

Postgraduate  School  (NPS),  with  actual  experimental  trials 

2 

being  conducted  in  the  NPS  C  Wargame  Analysis  and  Research 
Laboratory  (WARLAB)  using  NPS  officer-students  as  experimental 
subjects. 

This  set  of  experiments  compared  the  performance  of  higher 

and  lower  echelons  (i.e.,  Fleet  and  Carrier  Battle  Group  roles) 

in  the  conduct  of  planning  and  battle  management  tasks  and  also 

2 

examined  the  impact  of  role  and  specialization  on  C 
performance. 

The  effects  of  seniority,  addressed  by  this  report,  were 
not  part  of  the  analysis  plan  at  the  outset  of  the  experiment, 
and  data  to  support  them  were  sparse.  This  report  therefore 
represents  a  search  for  insights  more  than  an  account  of 
statistical  findings.  It  is  therefore  not  limited  to  the  NPS 
experiments,  but  includes  a  short  discussion  of  observations  in 
fleet  exercises. 


1985  C2 


Effectiveness  Experiments, 


12  Nay  1986 
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EXPERIMENTAL  DESIGN 


The  experimental  subjects  were  divided  into  two  groups  (A 
and  B)  with  each  group  being  subdivided  into  cells  representing 
nodes  in  the  command  structure.  The  experimental  command 
structure  consisted  of  five  command  nodes:  Commander  Second 
Fleet  ( COMSECONDFLT) ,  three  Carrier  Battle  Groups  (CVBGs),  and 
CONTROL/Commander-In-Chief  Atlantic  Fleet  (CINCLANTFLT) .  Per¬ 
formance  measures  were  taken  for  all  except  CONTROL/ 
CINCLANTFLT.  Unlike  previous  experiments,  where  students 
played  various  roles  throughout  the  experimental  runs,  in  this 
experiment  the  students  played  the  same  roles  throughout  (i.e., 
CVBG  commander,  action  officer,  communicator,  etc.). 

The  scenario  setting  is  a  battle  force  consisting  of  three 
CVBGs  operating  under  a  numbered  fleet  commander  in  a  high 
threat  environment.  Experimental  trials  are  conducted  in  both 
a  clear  and  a  disturbed  communications  environment.  As  with 
previous  experiments,  these  experiments  examine  the  impact  of 
varying  organizational  structures  on  the  performance  of  the 
command  nodes  and  the  force  as  a  whole. 

2 

The  C  performance  of  the  experimental  cells  under  varying 
conditions  is  scored  using  measures  of  performance  derived  from 
the  Headquarters  Effectiveness  Assessment  Tool  (HEAT).  The 
performance  measures  are  tailored  to  accommodate  inherent  simu¬ 
lation  and  laboratory  artificialities  and  collectible  data. 
Tactical  battle  outcomes,  provided  by  the  simulation,  are  also 
used  to  measure  group  performance. 

For  each  experimental  trial,  a  team  is  required  to 
comprehend  a  military  problem,  devise  a  solution,  and  then  at¬ 
tempt  to  implement  it  despite  ORANGE  interference.  Systematic 
variation  of  factors  over  many  such  trials  produces  a  rich  ex¬ 
perimental  database.  From  these  data  come  insights  regarding 

2  2 
C  theory  and  preliminary  estimates  of  causation  within  C 

systems. 


SENIORITY  VARIATION 


Experimental  results  to  date  are  internally  consistent, 
but  the  range  of  applicability  remains  unexamined.  Therefore, 
one  research  objective  of  the  most  recent  experiments  was  to 
conduct  duplicate  trials  using  personnel  with  varying  senior¬ 
ity,  experience,  and  expertise.  Administrative  restrictions 
prevented  duplicate  trials,  but  modification  and  careful  analy¬ 
sis  of  the  primary  trials  has  allowed  some  testing  of  impacts 
of  personnel  variation. 

Seniority  has  been  introduced  in  two  ways: 

•  actual  variation  in  the  seniority  of  the  officer 
assuming  the  role  of  the  senior  BLUE  force 
commander  (CONSECONDFLT) ; 

•  notional  seniority  variation  defined  by  the 
position  of  the  role  in  the  command  hierarchy. 

The  actual  variation  in  CONSECONDFLT  saw  that  role  played 
by  a  Navy  Lieutenant  and  an  Air  Force  Captain  (NPS  students); 
two  Navy  Captains  (NPS  faculty  members);  and  a  Rear  Admiral 
(from  OP  953).  The  NPS  faculty  members  involved  were  the 
director  of  the  tactics  department  and  a  senior  professor  who 
has  published  widely  on  naval  command  and  control.  Of  the  16 
game  "days"  played  by  each  group,  a  Navy  Captain  participated 
in  one  day,  and  the  Rear  Admiral  in  a  second;  14  days  (7  ses¬ 
sions)  were  played  entirely  by  junior  personnel. 


Notional  variation  saw  differing  command 
comparably  staffed  but  with  different  authority, 
sibility,  and  discretion. 
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HYPOTHESIZED  IMPACT 


The  literature  on  experimentation  provides  two  arguments 
for  improved  individual  performance  when  senior  personnel  are 
present.  First,  experience  matters.  Senior  personnel  will 
normally  have  greater  experience  and  perform  laboratory  tasks 
that  are  realisticly  better  than  less  experienced  subjects. 
Second,  more  junior  personnel  have  higher  motivation  and  stimu¬ 
lation  when  senior  personnel  are  present.  Greater  realism  is 
perceived  and  an  opportunity  for  gaining  attention  and  building 
reputation  (for  good  or  ill)  is  perceived  by  junior  personnel. 


FINDINGS 


The  basic  findings  are  as  follows: 


•  The  effects  of  seniority  were  mixed.  Real 
seniority  had  a  weak  tendency  to  decrease  C2 
capacity.  Notional  seniority  tended  to  improve 
performance. 

2 

9  How,  and  how  much,  seniority  helps  C  depended 
upon  which  team  was  observed. 

Although  the  experiment  did  not  actively  seek  different 

group  behaviors,  observation  suggested,  and  subsequent  analysis 

2 

confirmed,  the  presence  of  two  distinct  approaches  to  C  .  The 

2 

differences  between  the  two  groups'  approaches  to  C  can  be 
seen  by  comparing  Figures  1  and  2.  Figure  1  displays  a  causal 
influence  matrix  for  Group  A,  and  Figure  2  for  Group  B.  Al¬ 
though  it  is  difficult  to  generalize  about  the  patterns  of 
these  matrices,  it  is  clear  that  they  are  different.  Only 
about  half  of  the  entries  in  each  figure  have  a  corresponding 
entry  in  the  other.  These  differences  confounded  the  statis¬ 
tical  results  originally  expected  from  the  experiments,  and  can 
be  seen  to  some  extent  in  the  effects  of  seniority. 


♦Confidence  level  less  than  95% 

#Average  node-level  coefficient  from  incoming  to  outgoing  message  volume 


♦Confidence  level  less  than  95% 

iAverage  node-level  coefficient  from  incoming  to  outgoing  message  volume 


Personnel  Seniority 


Both  Figures  1  and  2  show  seniority  as  tending  to  have  a 

2 

negative  effect  on  C  capacity.  (The  capacity  measure 

2 

incorporates  both  the  scope  of  C  activity  and  the  quality  of 
2 

C  performance.)  This  finding  is  counter-intuitive,  and  must 
in  any  case  be  qualified  by  the  following  considerations: 

•  the  effect  is  weak,  i.e.,  the  regression 
coefficients  are  small; 

•  for  Group  A,  the  hypothesis  that  the  coefficent 
is  zero  can  be  rejected  only  at  a  confidence 
level  of  88%.  Normal  scientific  standards  would 
require  a  level  of  .95  or  better  for  acceptance, 
but  the  small  number  of  relevant  trials  makes 
such  a  level  difficult  to  obtain. 

For  Group  B,  it  is  possible  to  trace  two  indirect  chains 

2 

of  effects  through  Figure  2  from  seniority  to  C  capacity. 
However,  the  net  effects  of  these  chains  differ  in  sign,  and 
the  direct  coefficient  (-0.17)  must  be  taken  as  the  best 
estimate  of  the  effect  of  seniority. 

Role  Seniority 

The  second  detectable  impact  of  "seniority"  came  from  role 
definition.  Here,  of  course,  seniority  is  notional  rather  than 
actual.  Seniority  is  presumed  to  accompany  and  partly  account 
for  differences  in  command  node  authority  and  responsibility. 

2 

In  fact,  comparable  personnel  were  used  throughout  the  C 
system.  What  differed  was  the  command  role  each  person 

assumed.  What  appeared  to  happen  is  that  people  "grew  into" 
their  experimental  role.  This  growth  produced  some  dramatic 
contrasts . 


•  Subordinate,  or  more  "junior",  nodes  behaved  as 
if  they  were  at  the  limit  of  c2  capacity. 
Therefore  they  tended  to  trade  between  C2 
quality  and  C2  scope  as  follows: 

2  ,  27  2 

C  quality  C  scope 

-.41 

•  Conversely,  superior  or  more  "senior"  nodes  were 
so  focused  on  c2  planning  that  scope  and  quality 
reinforced  each  other  as  in: 

+  .30 

2  ,  2 

C  quality  - ►  C  scope 

+  .40 

The  basic  distinction  was  that  the  "junior"  nodes  acted  on 
2 

average  as  if  C  capacity  must  be  allocated  between  quality  and 

scope,  with  one  being  improved  only  at  the  expense  of  the 

2 

other.  Notionally,  more  "senior"  nodes,  however,  showed  C 
scope  and  quality  to  be  naturally  reinforcing:  to  attempt  more 
improved  quality,  and  improving  quality  encouraged  growth  of 
scope. 


The  coefficients  shown  above  are  averages  of  the 
statistically  significant  values  for  Group  B.  In  Group  A,  the 
same  pattern  appeared,  but  none  of  the  coefficients  were 
significantly  different  from  zero. 


SENIORITY  IN  FLEET  EXERCISES 


Recent  exercises  (Battle  Force  In-port  Training,  or  BFIT ) 
conducted  in  the  U.S.  Second  Fleet  have  used  scenarios  similar 
to  the  one  in  this  experiment;  and  performance  of  the  partici¬ 
pating  battle  staffs  has  also  been  evaluated  using  measures 
taken  from  HEAT. 


Some  effects  of  varying  the  seniority  of  the  the 
participants  have  been  observed  in  these  exercises.  The 
effects  are  best  summed  up  by  saying  that  the  presence  of 
senior  decisionmakers  (0-6  and  above)  in  the  command  center 
paralleled  a  measurably  higher  level  of  performance  by  the 
staff  as  a  whole.  Specifically,  in  BFIT  2-86,  where  the 
presence  of  senior  personnel  was  intermittent  compared  to 
earlier  exercises,  several  HEAT  measures  (notably  the  time 
taken  to  complete  a  decision  cycle)  were  significantly  worse. 

Unlike  the  experiments,  the  structure  of  the  exercises  did 
not  allow  control  of  the  level  of  seniority  or  repeated  trials 
to  establish  statistical  correlation.  The  association  of  the 
changes  in  performances  with  the  participation  of  senior  per¬ 
sonnel  is  based  on  the  judgment  and  comments  of  experts  who 
were  present.  Professional  observers  from  Tactical  Training 
Group  Atlantic  ( TACTRAGRULANT )  feel  very  strongly  about  the 
effect  and  have  repeatedly  pressed  the  argument  that  perform¬ 
ance  is  impacted  by  senior  presence  and  involvement. 

The  effect  described  here  pertains  to  real  seniority.  The 
effect  of  notional  seniority,  observed  in  this  experiment,  has 
not  been  isolated  in  the  exercises. 


CONCLUSIONS 


The  results  of  this  investigation,  which  was  initiated 
well  after  the  experiment  had  been  designed,  are  not  con¬ 
clusive.  The  small  number  of  cases  involving  senior  personnel 
(4  out  of  32)  probably  limited  the  statistical  significance  of 
the  findings.  The  fact  that  notional  seniority  was  not  defined 
as  an  experimental  parameter  limited  the  scope  and  precision  of 
its  investigation. 


I  Predictable  effects  of  seniority  on  staff  behavior  may 

I  have  implications  for  the  design  of  headquarters.  On  the  other 

hand,  the  absence  of  such  effects  extends  the  validity  of 
|  observations  made  with  more  junior  staffs.  The  effects  of 

seniority  therefore  remain  a  subject  of  experimental  interest. 

i  Future  experiments  should  be  designed  to  be  balanced  so  as  to 

! 

give  those  effects  full  play,  and  to  permit  as  thorough  an 
i  analysis  of  those  effects  as  is  provided  for  other  variables. 

1  in  particular,  experimental  participants  should  include  a  much 

larger  proportion  of  senior  personnel. 

It  would  therefore  be  useful  if  future  DCA  sponsored 
experiments  were  located  in  a  greater  variety  of  testbeds  and 
laboratories,  particularly  those  where  more  senior  personnel 
routinely  participate  in  exercise  play. 

I 

i 
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